24 research outputs found
Designing Digital Art and Communication Tools Inspired by Traditional Craft
Ph.DDOCTOR OF PHILOSOPH
Automated Conversion of Music Videos into Lyric Videos
Musicians and fans often produce lyric videos, a form of music videos that
showcase the song's lyrics, for their favorite songs. However, making such
videos can be challenging and time-consuming as the lyrics need to be added in
synchrony and visual harmony with the video. Informed by prior work and close
examination of existing lyric videos, we propose a set of design guidelines to
help creators make such videos. Our guidelines ensure the readability of the
lyric text while maintaining a unified focus of attention. We instantiate these
guidelines in a fully automated pipeline that converts an input music video
into a lyric video. We demonstrate the robustness of our pipeline by generating
lyric videos from a diverse range of input sources. A user study shows that
lyric videos generated by our pipeline are effective in maintaining text
readability and unifying the focus of attention
VCoach: A Customizable Visualization and Analysis System for Video-based Running Coaching
Videos are accessible media for analyzing sports postures and providing
feedback to athletes. Existing video-based coaching systems often present
feedback on the correctness of poses by augmenting videos with visual markers
either manually by a coach or automatically by computing key parameters from
poses. However, previewing and augmenting videos limit the analysis and
visualization of human poses due to the fixed viewpoints, which confine the
observation of captured human movements and cause ambiguity in the augmented
feedback. Besides, existing sport-specific systems with embedded bespoke pose
attributes can hardly generalize to new attributes; directly overlaying two
poses might not clearly visualize the key differences that viewers would like
to pursue. To address these issues, we analyze and visualize human pose data
with customizable viewpoints and attributes in the context of common
biomechanics of running poses, such as joint angles and step distances. Based
on existing literature and a formative study, we have designed and implemented
a system, VCoach, to provide feedback on running poses for amateurs. VCoach
provides automatic low-level comparisons of the running poses between a novice
and an expert, and visualizes the pose differences as part-based 3D animations
on a human model. Meanwhile, it retains the users' controllability and
customizability in high-level functionalities, such as navigating the viewpoint
for previewing feedback and defining their own pose attributes through our
interface. We conduct a user study to verify our design components and conduct
expert interviews to evaluate the usefulness of the system
Vignette: A Style Preserving Sketching Tool for Pen-and-Ink Illustration with Texture Synthesis
Pen-and-ink illustrations take significant amounts of skill, artistry, and patience to create. Digital tools are widely used to accelerate the process; but they provide less artistic freedom and cannot easily capture illustrators ’ personal style. Furthermore, these tool
SandCanvas: A Multi-touch Art Medium Inspired by Sand Animation
10.1145/1978942.1979133Conference on Human Factors in Computing Systems - Proceedings1283-129
Autocomplete Element Fields
Aggregate elements are ubiquitous in natural and man-made objects. Interactively authoring these elements with varying anisotropy and deformability can require high artistic skills and manual labor. To reduce input workload and enhance output quality, we present an autocomplete system that can help users distribute and align such elements over different domains. Through a brushing interface, users can place and mix a few elements, and let our system automatically populate more elements for the remaining output. Furthermore, aggregate elements often require proper direction/scalar fields for proper arrangements, but fully specifying such fields across entire domains can be difficult or inconvenient for ordinary users. To address this usability challenge, we formulate element fields that can smoothly orient all the elements based on partial user specifications without requiring full input fields in any step. We validate our prototype system with a pilot user study and show applications in design, collage, and modeling